Papers with manual inspection
Benchmarking Testing in Automated Theorem Proving (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing evaluations rely on indirect proxies such as lexical overlap with human-annotated proof, or expensive manual inspection. |
| Approach: | They propose a framework that evaluates the semantic correctness of formal theorems . they use a set of problems paired with 41 successor theorels to compare them . |
| Outcome: | The proposed framework evaluates the semantic correctness of formal theorems using real-world Lean 4 repositories. |